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Performance  appraisal  means  different  things  to  different  people. 
Because  these  varying  interpretations  affect  behavior  performance 
appral  i.il  systems  do  not  always  achieve  their  goals. 

For  the  past  three  years  we  have  Investigated  performance  appraisal 
system  design.  We  seek  to  identify  process  and  measurement  Issues  which 
will  help  performance  appraisal  system  administrators  accomplish  their 
objectives.  In  pursuit  of  our  goal,  we  have  studied  the  meanings 
attached  to  performance  appraisal  and  the  varieties  of  their  designs. 

Our  goal  has  been  to  understand  how  these  factors  interact  to  affect 
performance  appraisal.  In  this  article  we  shall  share  our  findings  and 
explore  their  implications  for  human  resource  professionals. 

What  is  Performance  Appraisal? 

To  some,  performance  appraisal  is  an  interpersonal  experience. 
Performance  appraisal  provides  an  opportunity  for  managers  and  subordi¬ 
nates  to  communicate  their  assessments  and  expectations.  Performance 
appraisal  thus  functions  to  strengthen  the  communication  and  relation¬ 
ship  between  managers  and  subordinates. 

To  others,  performance  appraisal  is  a  bureaucratic  process  by  which 
an  employee's  "performance"  is  quantified,  documented  and  fed  into  the 
paper  mill  of  the  organization.  The  appraisal  then  becomes  the  basis 
for  administration  decisions  regarding  salary  and  promotions. 

To  still  other,  performance  appraisal  serves  as  the  interface 
between  the  person  and  the  organization  by  allowing  these  people  to  know 
the  organization's  official  evaluation  of  their  work  and  perhaps  receive 
recognition  for  a  job  well  done. 
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It  is  clear  then  that  performance  appraisal  is  a  process  with 
multiple  definitions.  When  corporate  executives  are  asked  why  their 
organizations  conduct  performance  appraisals,  the  list  of  reasons  is 
often  lonn.  In  general,  executives  respond  that  per  Ini  malice  appraisal 
is  used  to  (1)  measure  performance,  (2)  motivate  employees,  (3)  improve 
performance,  (4)  plan  future  work,  (5)  teach  employees  what  they  should 
do,  and  (6)  distribute  pay  raises.  People  often  answer  with  conviction 
and  react  with  amazement  at  other's  notions.  In  fact,  researchers  have 
identified  fourteen  purposes  for  doing  performance  appraisal  (Bittner, 
1948).  Implicitly  or  explicitly  everyone  believes  performance  appraisal 
has  a  purpose. 

* 

Unfortunately,  these  idiosyncratic  purposes  often  conflict  and 
people  with  varying  expectations  participate  in  the  same  event.  When 
this  occurs,  no  one's  needs  are  met.  Therefore,  in  order  for  a 
performance  appraisal  system  to  work,  its  goals  must  be  made  explicit 
and  care,  must  be  taken  to  ensure  they  arc  accepted. 

Thus,  the  first  step  in  system  design  is  to  determine  the 
organization's  reason  for  doing  performance,  appraisal.  Too  frequently, 
this  step  is  neglected  and  measurement  issues  aro  addressed,  an  approach 
which  rarely  loads  to  effective  system  design.  To  effectively  design  a 
system  the  organization  must  identify  its  purpose  for  appraising 
performance,  then  by  combining  appropriate  design  elements,  a  strategy 
for  accomplishing  those  purposes  can  be  realized. 


Wh  a  t  A  re  Performance  Appra i  sn 1  System  Design  Elements ? 

By  "design  elements"  we  refer  to  choices  the  system  designers  make 
about  the  content  and  process  of  an  appraisal  system.  For  example,  the. 
system  designer  must  decide: 

1.  Which  scoring  method  to  use  (e.g.,  trait  ratings,  behav¬ 
ioral  ratings,  narratives,  goals,  ranking,  critical 
incidents) ; 

2.  What  is  discussed  during  the  performance  appraisal 
session  (e.g.,  career  development,  salary  decisions, 
training  opportunities); 

3.  Who  contributes  information  for  the  evaluation  (subordi¬ 
nate,  other  supervisors,  supervisor's  supervisor, 
subordinate's  subordinate,  etc.); 

A.  Who  completes  the  performance  appraisal  form,  and  when; 

5.  Who  decides  the  criteria  for  evaluation; 

6.  Whether  there  is  an  appeal  process;  and 

7.  What  training,  if  any,  must  be  conducted  to  support  the 
system. 

Of  course,  this  list  of  elements  is  not  exhaustive  and  none  of  the 
elements  arc  totally  under  the  control  of  the  system  designers. 
Nevertheless,  by  understanding  the  probable  effect  of  design  elements, 
system  designers  can  more  effectively  achieve  their  objectives. 


How  Pan  These  Design  Elements  Be  Transla ted  To  System  Results 7 

No  "one  best  way"  to  design  a  performance  appraisal  system  exists. 
System  designers  must  weigh  the  strengths  and  weaknesses  of  each  system 
element  against  the  context  and  goals  of  the  performance  appraisal 
system.  Although  there  is  no  best  way  to  design  a  performance  appraisal 
system,  certain  design  elements  accomplish  certain  purposes  more 
clflcicully  than  others.  For  example: 
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System  designers  interested  in  the  distribution  of 
limited  funds  may  choose  a  ranking  strategy  which  forces 
a  distribution  of  performance  scores  (Cummings  and 
Schwab,  1973). 

2.  System  designers  interested  in  the  development  of  the 
subordinate's  skills  may  choose  a  behavioral  observation 
approach,  which  allows  I  he  manager  and  subordinate  to 
identity  weaknesses  in  the  subordinate's  performance 
(Latham  and  Woxley,  1981). 

Designers  Interested  in  motivating  performance  Improve* 
men l  may  choose  a  work  planning  (goal  setting)  approach 
(Latham  and  Yuk,  197.1). 

4.  Designers  interested  in  employee  involvement  and  satis¬ 
faction  may  choose  a  system  which  requires  self-appraisal 
or  some  other  form  of  employee  input  (Mohrman,  1981). 

The  design  of  a  performance  appraisal  system  is  a  difficult  task.  The 

system  designer  who  tries  to  meet  one  set  of  objectives  may  tip  the” 

balance,  thereby  not  achieving  some  others.  Added  to  this  dilemma  are 

the  effects  of  system  users  themselves  on  the  performance  appraisal 


How  A re  These  Design  Elements  Interpreted  By  The  People  Who  Use  Them7 

"\  '  person  is  likely  to  emphasize  that  aspect  of  the  performance 
appraisal  system  which  serves  the  goal  she/he  has  set  for  the  system. 
For  example,  someone  who  thinks  performance  appraisal  is  primarily  a  way 
to  document  a  subordinate 's  performance  will  spend  less  time  planning 
future  work  or  eliciting  the  subordinate's  reactions  titan  will  one  who 
believes  that  performance  appraisal  is  a  way  to  motivate  subordinates 
and  improve  performance.  The  latter  person,  however,  may  spend  less 
time  discussing  past  performance. 
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Since  individuals  tend  to  use  performance  appraisal  systems 
according  to  thoir  individual  notions  of  peifcrmancu  appraisal,  system 
designers  are  hard-pressed  to  design  a  system  that  will  meet  the 
organization's  purpose  for  doing  performance  appraisal.  Nevertheless, 
we  have  found  that  certain  design  elements  are  more  predictable  than 
others.  In  the  following  sections  we  discuss  a  portion  of  our  research 
which  analyzes  the  impact  of  three  design  variables  on  performance 
improvement,  an  often  stated  purpose  of  performance  appraisal. 

Which  Design  Elements  Arc  More  Predictable  Than  Others? 

Basic  to  our  research  is  the  assumption  that  the  success  of  any 
performance  appraisal  system  is  as  attributable  to  process  issues  as  it 
is  to  the  type  of  measurement  recording  form  used.  Wn  therefore 
investigated  the  effects  of  both  process  and  measurement  issues  on 
pert ormance  appraisal  results. 

In  1979,  a  large  multinational  company  was  interested  in 
understanding  more  about  its  performance  appraisal  practices.  The 
Center  for  Effective  Organization  at  USC  undertook  a  project  that 
documented  existing  performance  appraisal  objectives,  beliefs  and 
assumptions,  described  and  evaluated  the  company's  performance  appraisal 
system,  ami  made  recommendations  regarding  performance  appraisal 
practices  (Kesnlck  and  Mohrman,  1'IKI).  fur  the  next  year  information 
was  collected  I  rum  personnel  administrators,  high  level  executives,  ami 
manager  and  subordinate  pairs.  The  findings  reported  here  are  an 
analysts  of  the  information  called  then 


Thu  study  afforded  us  mi  opinimiii  i  ty  to  test  our  assumption  that 
process  as  well  as  measurement  Issues  impact  performance  appraisal 
results.  In  particular  we  were  interested  in  the  effect  three  design 
variables,  one  measurement  and  two  process,  had  on  perceptions  of 
per I  onn.inue  improvement . 

Most  performances  appraisal  systems  have  as  a  goal  the  improvement 
of  employee  performance.  Since  work  planning  or  goal  setting  is  thought 
to  lead  to  performance  improvement  (Latham  and  Yuk,  1975),  system 
designers  often  develop  performance  appraisal  forms  that  incorporate 
those  elements  Such  forms  frequently  require  a  list  of  goals  and 
objectives  and  assign  points  for  goal  attainment. 

* 

We  hypothesized  that  if  the  use  of  workplanning  forms  affects 
perceptions  of  work  planning,  people  using  such  forms  would  report  more 
work  planuing  during  their  appraisal  session  than  people  using  other 
types  of  forms. 

In  turn,  if  people  report  work  planning  during  their  appraisal 
session,  we  expect  they  would  also  report  learning  from  the  appraisal 
session  and  ultimately  report  on  Improvement  in  their  porformam  a. 

To  test  this  hypothesis,  wo  collected  all  of  the  performance 
appraisal  forms  used  in  the  company  (approximately  50  different  forms) 
and  scored  them  for  inclusion  of  work  planning.  Of  571  possible 
manager/subord inate  pairs,  we  have  information  on  421  pairs.  Of  those, 
72%  used  work  planning  forms  while  28*  used  another  type  of  form. 
Through  use  of  an  analysis  of  variance  (ANOVA) ,  we  then  compared 
perceptions  of  work  planning  for  two  groups,  those  who  used  work 
planning  forms  and  those  who  used  other  types  of  forms.  The  ANOVA 


-6- 


revealed  no  s  Ign  1 1  leant  main  effects  for  use  of  the  form 
(K(l,lt>7)  =  0.16,  p  <  0.69)  and  no  significant  interactions  (F(l,167  = 

1.18,  |>  <  0.28)  between  form  use  anti  organizational  status.  All  groups 
reported  an  equivalent  amount  of  work  planning  during  their  performance 
appraisal  session.  In  other  words,  the  fact  that  work  planning  was 
dictated  by  the  forms  had  no  effect  on  managers1  or  subordinates’ 
perceptions  of  work  planning. 

Interestingly  enough,  however,  two  procedures  (when  the  form  was 
completed  anti  whether  or  not  the  subordinate  compiled  information  for 
review)  did  affect  perceptions  of  work  planning.  To  test  the  effect  of 
Liming  of  form  completion  on  perceptions  of  work  planning  we  again  used 
an  ANOVA.  This  time  we  compared  perceptions  of  work  planning  for  two 
groups  of  managers  and  subordinatcs*-thosc  who  completed  the  form  before 
the  session  and  those  who  waited  until  during  or  after  the  review  to 
complete  the  appraisal  form.  The  analysis  revealed  a  marginally 
significant  main  effect  for  form  completion  (F(l,200)  =  3.05,  p  <  .08). 
An  examination  of  the  means  reveals  that  both  managers  and  subordinates 
perceived  more  work  planning  when  the  manager  waited  until  during  or 
alter  the  review  session  to  complete  the  form. 

To  find  out  what  happens  when  subordinates  compile  information  for 
their  performance  review,  we  again  compared  perceptions  of  work  planning 
for  two  groups  of  managers  and  subordinates:  those  pairs  in  which 
subordinates  compiled  information  for  the  review  and  those  pairs  in 
which  this  was  not  the  case.  The  ANOVA  revealed  a  significant 
interaction  (F(l,209)  =  9.02,  I*  <  .003).  An  examination  of  the  means 
indicates  that  subord inates ,  but  not  managers,  perceived  more  work 
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planning  during  the  session  when  Lite  subordinate  was  asked  to  contribute 
information  for  the  review. 

As  well  as  impacting  perceptions  of  work  planning,  these  two 
procedural  variables  effect  the  subordinates1  perceptions  of  ownership 
for  the  appraisal  session.  An  ANOVA  of  the  timing  of  the  form 
completion  reveals  a  marginally  significant  main  effect,  (F(l,127)  = 
n.4;',  I*  «•  .07).  An  exnminal  ion  of  the  means  reveals  that  both  managers 
and  suhurd  iuales  perceive  the  subordinate  has  more  ownership  ol  tin' 
appraisal  session  when  the  form  is  completed  during  or  after  the 
appraisal . 

When  the  subordinate  contributes  information  for  the  review  an 
examination  of  the  means  reveals  both  the  manager  and  the  subordinate 
believe  the  subordinate  had  more  ownership  of  the  event.  The  effect  is 
more  pronounced  for  subordinates.  The  results  of  the  ANOVA  indicate  a 
significant  main  effect  (F(l,233)  =  21.03,  P  <  .001)  and  interaction 
( F ( 1  ,233)  =  A. 81,  P  <  .03). 

A  significant  aspect,  of  these  findings  is  that  both  managers  and 
subordinates  report  performance  improvement.  This  conflicts  with  one  of 
the  most  pervasive  findings  in  our  research:  that  disagreement  between 
the  perceptions  of  managers  and  subordinates  is  the  rule,  not  the 
exception.  Their  perceptions  often  conflict,  not  only  in  the  level  of 
the  subordinate's  performance,  but  also  as  to  the  purpose,  content  and 
process  of  the  appraisal  interview.  The  above  represents  some  of  the 
few  instances  wo  have  found  in  which  subordinates  and  managers  tend  to 
agree  about  what  is  happening  during  and  as  a  consequence  of  performance 
appra isal . 
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Why  Do  Those  Design  Elements  Work? 

We  believe  these  procedures  lend  to  perceptions  of  planning  because 
they  facilitate  a  sense  of  ownership  for  the  performance  appraisal  event 
on  the  part  of  the  subordinate.  To  bn  effective,  work  planning  must  be 
"owned"  by  the  person  doing  the  work.  A  significant  part  of  any 
successful  Management  by  Objectives  (MHO)  system  lias  always  been  its 
part  icipat  ive  nature.  Most  author  ft ies  agree  that  effective  goal 
setting  must  include  employee  involvement  (McConkie,  1979).  Though  the 
intent  of  the  work  planning  form  may  have  been  for  the  subordinate  to 
feel  some  ownership  of  the  session,  in  this  case  the  intent  was  not 
real  i steel. 

On  the  other  hand,  concrete,  action  helped  the  subordinate  feel 
involvement  in  and  ownership  of  the  appraisal  session.  Concrete  action 
took  place  when  the  subordinate  contributed  information  and  when  the 
manager  waited  for  the  subordinate's  input  before  completing  the  form. 
Just  as  actions  speak  louder  than  words,  procedures  speak  louder  than 
forms.  They  carry  a  message  to  the  organization  members  about  the 
desired  flow  of  behavior  between  managers  and  subordinates.  They  are 
concrete  proof  that  the  organization  desires  the  subordinate's 
part  ic.  f  put  ion . 

What  Messages  Are  We  Delivering  To  System  Designers? 

Performance  appraisal  system  design  is  complicated.  Because  the 
system  involves  people  and  changing  environments,  designers  must  be 
prepared  to  redesign.  Performance  appraisal  design  is  an  interactive 
process:  what  seemed  the  best  so  In!  ion  In  one  situation  may  not  work 


well  two  or  three  years  later. 


If  wo  can  offer  any  guidance  to  system  designers,  it  is  to  be  clear 
about  wliat  the  organization  wants  the  performance  appraisal  system  to 
do.  hook  long  and  hard  at  yonr  system's  "behavior."  Is  it  in  line  with 
your  system's  words?  Finally,  understand  that  each  manager  and  each 
subordinate  have  their  own  notion  of  performance  appraisal.  They  know 
what  they  expect  from  it.  They  know  what  they  want  from  it.  These 
multiple  expectations  and  purposes  must  be  addressed  in  any  system 
design.  A  knowledge  of  performance  appraisal  options  and  their  probable 
outcome  is  essential  to  successfully  meet  the  performance  appraisal 
objectives  of  the  organization. 

Where  Do  We  Go  From  Mere? 

Obviously,  appraisal  system  design  requires  more  than  just  the 
elements  mentioned  here.  The  possible  configuration  of  design  elements 
is  almost  limitless.  Understanding  complex  issues  like  the  design  of 
performance  appraisal  systems  demands  research  and  experience  in  a  large 
number  of  organizations  with  a  variety  of  performance  appraisal  systems. 
We  are  currently  broadening  our  own  research  experience  and  hope  that 
l  lie  understanding  we  gain  will  help  designers  in  many  organizations.  In 
these  days  of  diminishing  monetary  resources,  it  is  important  that  human 
resources  be  used  /is  effectively  as  possible.  Performance  appraisal  is 
a  tool  that  can  make  that  happen.  [If  your  organization  is  involved  in 
performance  appraisul  and  would  like  to  participate  in  our  study  please 
contact  us,  Susan  Resnick  or  Monty  Mohrmnn  at  the  Center  for  Effective 
Organizations,  Graduate  School  of  Business  Administration,  University  of 
Southern  California,  I.os  Angeles,  California.] 
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